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Abstract 

Model-based object recognition commonly involves using a minimal set of matched model and 
image points to compute the pose of the model in image coordinates. Furthermore, recognition 
systems often rely on the "weak-perspective" imaging model in place of the perspective imaging 
model. This paper discusses computing the pose of a model from three corresponding points 
under weak-perspective projection. A new solution to the problem is proposed which, like 
previous solutions, involves solving a biquadratic equation. Here the biquadratic is motivated 
geometrically and its solutions, comprised of an actual and a false solution, are interpreted 
graphically. The final equations take a new form, which lead to a simple expression for the 
image position of any unmatched model point. 
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1 Introduction 

Recognizing an object generally requires finding correspondences between features of a model 
and an image. Since finding corresponding features often requires trying all possible correspon- 
dences, recognition systems frequently use correspondences between minimal sets of features 
to compute poses of the model. For instance, "alignment" techniques repeatedly hypothesize 
correspondences between minimal sets of model and image features, and then use those corre- 
spondences to compute model poses, which are used to find other model-image correspondences 
(e.g., [5], [10], [1], [9], [28], [29], [15], [3], [16]-[18], [30], [19]). In addition, "pose clustering" 
techniques use every correspondence between a minimal set of model and image features to 
compute a model pose, and then count the number of times each pose is repeated (e.g., [2], 
[26], [25], [23], [11], [4]). 

For computing poses of 3D objects from 2D images, a model of projection must be selected, 
and typically either perspective or "weak-perspective" projection is chosen. Weak-perspective 
projection is an orthographic projection plus a scaling, which serves to approximate perspective 
projection by assuming that all points on a 3D object are at roughly the same distance from the 
camera. For both perspective and weak-perspective projections, the minimal number of points 
needed to compute a model pose up to a finite number of solutions is three ([10], [18]). For 
point features, then, the problem is to determine the pose of three points in space given three 
corresponding image points. When perspective projection is the imaging model, the problem 
is known as the "perspective three-point problem" [10]. When weak-perspective is used, I shall 
call the problem the "weak-perspective three-point problem." 

A few methods for solving the weak-perspective three-point problem have been suggested in 
the past ([20], [8], [17], [18], [12]), and this paper proposes a new method (solution). The major 
differences with the new solution is that it motivates and explains the solution geometrically, 
and it does not compute a model-to-image transformation as an intermediate step. As will be 
demonstrated later, understanding the geometry is useful for seeing under which circumstances 
the solution simplifies or breaks, and for analyzing where the solution is stable. Furthermore, 
a geometric understanding may be useful for seeing how the solution is affected by error in the 
image and the model. 

In addition to providing a geometric interpretation, the solution in this paper gives direct 
expressions for the three matched model points in image coordinates, as well as an expression 
for the position in the image of any additional, unmatched model point. Earlier methods all 
require the intermediate computation of a model-to-image transformation. This is meaningful 
because, as mentioned above, many alignment-based recognition systems calculate the 3D pose 
solution many times while searching for the correct pose of the model. Consequently, avoiding 
the intermediate calculation of the transformation could cause such systems to run faster. 

To illustrate how significant such a speed-up can be, consider a system that performs 3D 
recognition by alignment using point features to generate hypotheses. The input to the system 
is a model and an image, and the goal is to identify all instances of the model in the image. 
The model is specified by a set of 3D points that can be detected reliably in images, along with 
any number of extended features whose projections can be predicted using points (e.g., line 



segments, some sets of curves, and edges represented point-by-point). From the image, a set of 
2D points is extracted by a low-level process that looks for points of the type corresponding to 
points in the model. The alignment algorithm proceeds as follows: 

1. Hypothesize a correspondence between three model points and three image points. 

2. Compute the 3D pose of the model from the three-point correspondence. 

3. Predict the image positions of the remaining model points and extended features using 
the 3D pose. 

4. Verify whether the hypothesis is correct by looking in the image near the predicted posi- 
tions of the model features for corresponding image features. 

This process is repeated until all pairs of triples of model and image (sensed) points have been 
tried. For m model points and s sensed points, there are (™)(^)3l distinct pairs of model and 
image point triples. Consequently, the running time for the algorithm grows with the cubes 
of the numbers of model and image points. Since these numbers can be large, the model and 
image points typically are grouped in advance so that only triples of points from the groups 
have to be tried (e.g., [23], [21], [18]). This can bring the number of pairs of triples into a 
range where the algorithm is practical. Then a "constant-times" speed-up in the innermost 
loop of the algorithm, that is, steps 2-4 listed above, could give a substantial improvement in 
the overall execution time. As already suggested, the solution given in this paper should make 
steps 2 and 3 significantly faster. 

From observing previous solutions, the solution given in this paper most resembles Ullman's 
([28], [17]), in that both end up having to solve the same biquadratic equation, although each 
derives the biquadratic differently. In this sense, the solution given here is an extension of 
Ullman's, because, unlike Ullman's solution, it resolves which of the two non-equivalent solutions 
to the biquadratic is correct. In addition, this paper explains graphically why the two solutions 
arise and to what geometry each corresponds. 

There is an intrinsic geometry that underlies the perspective three-point problem; it is 
shown in Fig. 1. In the figure, the three model points, too, mi, and m^, are being perspectively 
projected onto three image points, %q, ii, and ii, via lines through the center of projection (center 
point), p. The task is to recover too, m-i, and m^- The essential information is contained in the 
side lengths and angles of the surrounding tetrahedron. 

Similar to the perspective case, there is an intrinsic geometry underlying the weak-perspec- 
tive three-point problem, shown in Fig. 2. The picture shows the three model points being 
projected orthographically onto the plane that contains too and is parallel to the image plane, 
and then shows them being scaled down into the image. In addition, the picture shows the 
model points first being scaled down and then projected onto the image plane. In each case, 
the projection is represented by a solid with right angles as shown. The smaller solid is a 
scaled-down version of the larger. The relevant information consists of the side lengths of the 
solids and the scale factor. 

In what follows, first the perspective case is discussed (Section 2). Then I summarize 
how to compute 3D pose from three corresponding points under weak-perspective projection 




Figure 1: Model points too, to*i, and r?7*2 undergoing perspective projection to produce 
image points io, i\, and i^. a, b, and c are distances from the center point, p, to the 
model points. 



(Section 3). Third the 3D pose solution is shown to exist and be unique, and a geometrical 
interpretation is provided (Section 4). Next a direct expression is derived for the image position 
of an unmatched model point (Section 5). Then I review earlier solutions to the problem and 
present the three most related solutions in detail (Sections 7 and 8). In addition, the new and 
earlier solutions are examined and compared in terms of their stabilities (Sections 6 and 9). 

2 The Perspective Solution 

To see the difference between the perspective and weak-perspective cases, first let us observe 
exactly what is required for the perspective three-point problem. As pictured in Fig. 1, I will 
work in camera-centered coordinates with the center point at the origin and the line of sight 
along the z axis. The distances i?oi 5 -Ro2 5 an d R\2 come from the original, untransformed model 
points. The angles 0oi, #02, an d #12 can be computed from the positions of the image points, 
the focal length, and the center point. To see this, let / equal the focal length, and let the 
image points io, i\, ii be extended as follows: (x,y) — ► (x,y,f). Then 



cos 0oi = i-o ■ H, 



COS 0Q2 = io ■ 12, 



COS 012 = l\ ■ «2, 



:i: 



where in general v denotes the unit vector in the direction of v. The problem is to determine 
a, 6, and c given i?oi 5 -R027 -Ri2 5 cos #oi 5 cos #02 , an d cos #12. From the picture, we see by the 
law of cosines that 

a 2 + b 2 - 2ab cos O1 = R 2 01 (2) 

a + c — 2accos#o2 = -R02 (3) 

6 2 + c 2 - 26c cos 6»i2 = R 2 12 (4) 

Over time, there have been many solutions to the problem, all of which start with the above 
equations. The solutions differ in how they manipulate the equations when solving for the 
unknowns. Recently, Haralick et al. reviewed the various solutions and examined their stabili- 
ties [13]. 

Given a, 6, and c, we easily can compute the 3D locations of the model points: 

rfiQ = aio, itt-i = bi\, m^ = cii- (5) 

If a 3D rigid transformation is desired, it can be determined from the original 3D model points 
and the 3D camera-centered model points just computed. A simple method for doing so is 
given in Appendix A; for a least-squares solution, see Horn [14]. 

Although perspective (central) projection is a more accurate model, numerous researchers 
have used weak-perspective projection instead (e.g., [24], [20], [7], [8], [25], [28], [29], [21], [22], 
[16]- [18], [3], [30], [19], [12]). The justification for using weak-perspective is that in many cases 
it approximates perspective closely. In particular, for many imaging situations if the size of the 
model in depth (distance in z) is small compared to the depth of the model centroid, then the 
difference should be negligible [25]. 

There are some advantages to using weak-perspective instead of perspective. In particular, 
computations involving weak-perspective often are less complicated. In addition, the weak- 
perspective math model is conceptually simpler, since it uses orthographic instead of perspective 
projection. Another advantage is that we do not need to know the camera focal length or center 
point. Furthermore, there are fewer solutions to deal with — four for perspective and two for 
weak-perspective ([10], [18]). It should be understood, however, that finding two solutions 
instead of four is only an advantage if the four solutions actually collapse to two; otherwise, at 
least two of the solutions are missed. 

Lastly, the weak-perspective imaging model can be used without modification to recognize 
scaled versions of the same object, since the built-in scale factor incorporates object scale. For 
perspective to handle scale, an additional scale parameter must be used. On the other hand, 
weak-perspective is unable distinguish objects that differ only in size, since a smaller scale could 
mean the object is smaller or further away. Nonetheless, in cases where the weak-perspective 
approximation applies, the perspective solution may be unstable in distinguishing different- 
sized objects ([27], [29], [18]). In these cases, moving the object further out in depth, that is, 
past the point where perspective and weak-perspective projections are essentially equivalent, 
will have the same effect in the image as uniformly scaling the object down in size. Since the 
perspective solution always distinguishes the depth and size of the object, this suggests that 



small variations in the image could lead to very different interpretations for the size as well as 
the depth. 

In sum, there are significant advantages to using weak-perspective in place of perspective, 
and under many viewing conditions the weak-perspective approximation is close to perspective. 
As suggested in the introduction, for these situations it would be useful to know how to solve, 
using weak-perspective projection, the problems of recovering the 3D pose of a model and 
computing the image position of a fourth model point. 

3 Computing the Weak-Perspective Solution 

This section provides a summary of the results I will derive in the next two sections. Specifically, 
it tells how to compute the locations of the three matched model points and the image location 
of any additional, unmatched model point. 

For reference, the geometry underlying weak-perspective projection between three corre- 
sponding points, which was described in the introduction, is shown in Fig. 2. All that is 
pertinent to recovering the 3D pose of the model are the distances between the model and 
image points. Let the distances between the model points be (Roi,Ro 2 ,Ri 2 ), an d the corre- 
sponding distances between the image points be (doi, do 2 , ^12)- Then the parameters of the 
geometry in Fig. 2 are 

i _l_ a //j2 — n r 

(6) 

(7) 
(8) 
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if d 01 + d 02 - d 12 < s (R 01 + R 02 - R 12 ), 
otherwise. 



£12) (9) 

) (10) 

(11) 
(12) 

As the equations show, the solution has a two-way ambiguity except when hi and h 2 are zero. 
The ambiguity corresponds to a reflection about a plane parallel to the image plane. When 
h\ = h 2 = 0, the model triangle (the triangle defined by the three model points) is parallel to 
the image triangle (the triangle defined by the three image points). As a note, a and c measure 
sixteen times the squares of the areas of the model and image triangles, respectively. Further, 
the solution fails when the model triangle degenerates to a line, in which case a = 0; in fact, 
this is the only instance in which a solution may not exist (for a discussion of this case, see 
Section 4.5). Note, however, that no such restriction is placed on the image triangle; so the 
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Figure 2: Model points too, to*i, and r?7*2 undergoing orthographic projection plus scale 
to produce image points io, i\, and ii- 



image points may be collinear. Even so, care should be taken since the solution may be unstable 
when image points are collinear, when the model points are collinear, or when one of the sides 
of the model triangle is parallel to the image plane (see Section 6). 

Next, I give an expression for the image location of a fourth model point. Originally, the 
models points are in some arbitrary model coordinate frame. Also, the image points are in 
a camera-centered coordinate frame in which the image serves as the x-y plane. Denote the 
original, untransformed model points by p 8 -, to distinguish them from the camera-centered model 
points rfii shown in Fig. 2. Using po, pi, and p*2, solve the following vector equation for the 
"extended affine coordinates," (a,/?, 7), of p^: 



P~3 = a(pl - Po) + /3(p~2 - Po) + 7 (Pi - Po) x (P~2 - Po) + Po 
Given image points %q = (xo,yo), i\ = (x\,yi), and ii = (^2, 2/2)5 l e t 



'131 



x 01 

«02 



x , 



l/oi = 2/1 - 2/0, 
2/02 = 2/2 - 2/o- 



Then the image location of the transformed and projected p*3 is 

(ax 01 + [ix 02 + l{yoiH 2 - y 02 Hi) + x , ay 01 + [iy 02 + l{-x iH 2 + x 02 H 1 ) + y ). (14) 

Lastly, the weak-perspective solution can be used to compute the 3D locations of the model 
points in camera-centered coordinates: 

too = -(x ,y ,w) (15) 

s 

m x = -(x 1 ,y 1 ,h 1 +w) (16) 

m 2 = -(x 2 ,y2,h 2 + w), (17) 

where w is an unknown offset in a direction normal to the image plane. It is worth noting that 
if the 3D rigid transform that brings the model into camera-centered coordinates is desired, it 
can be computed from these three camera-centered model points and the original three model 
points. The unknown offset w drops out when computing the rotation and remains only in the 
z coordinate of the translation, which cannot be recovered. As mentioned in Section 2, a simple 
method for computing the transform is given in Appendix A, and a least-squares solution was 
given by Horn [14]. 

4 Existence and Uniqueness of the 3D Pose Solution 

In deriving the 3D pose solution, I start with the basic geometry for the weak-perspective three- 
point problem, shown in Fig. 2. Fig. 3 shows the smaller solid again with more labels. There 
are three right triangles in the solid, from which three constraints can be generated: 

h 2 + d 2 01 = (sR 01 ) 2 (18) 

h 2 2 + d 2 02 = (sR 02 ) 2 (19) 

(h - h 2 ) 2 + d\ 2 = (sR 12 ) 2 (20) 

It should be pointed out that the distances Roi, -Ro2 5 R\2i ^oi 5 ^02, d\ 2 and the scale factor s 
are all positive, but the altitudes hi, h 2 along with Hi, H 2 are signed. Since h\ and h 2 are 
signed, having "h\ — h 2 v in the third equation is an arbitrary choice over "h\ + h 2 v ; it was 
chosen because, when hi and h 2 are positive, it directly corresponds to the picture in Fig. 3. 
Multiplying the third equation by —1 and adding all three gives 

2hih 2 = s (R 01 + R 02 - R 12 ) - (d 01 + d 02 - d 12 ). 

Squaring and using the first two equations again to eliminate h\ and h\, we have 

4(s 2 R 2 01 - d 2 01 )(s 2 R 2 2 - d 2 2 ) = (s 2 (R 2 01 + R 2 2 - R 2 2 ) - (d 2 01 + d 2 2 - d 2 2 )f , (21) 

which leads to a biquadratic in s (for details see Appendix B): 

as 4 - 26s 2 + c = 0, (22) 




Figure 3: Smaller solid representing orthographic projection plus scale of three model 
points into an image. 
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Rl2)i d 01 + rf 02 ~ rf 12) 






= d 01 (-R 01 + R 02 + R 12 ) + d 02 (R 01 


- #02 + #12) + ^12 (#01 + #02 " 


" #12 


c 


= 4a 01 a 02 — (a 01 + d 02 — d 12 ) 







= (d 01 + d 02 + d 12 )(-d 01 + d 02 + d 12 )(d 01 - d 02 + d 12 )(d 01 + d 02 - d 12 ) 

This biquadratic is equivalent to the one originally derived by Ullman. But Ullman made no 
attempt to interpret or decide among its solutions, which will be done here. 

To prove existence and uniqueness, the biquadratic's solutions must be examined. We are 
interested only in positive, real solutions for s, the scale factor. In general, the positive solutions 
of the biquadratic are given by 



lb±v¥ 



ac 



(23) 



Depending on the radicands, there will be zero, one, or two real solutions. Particularly, we 
are interested in whether each number of solutions can arise, and, if so, to what the solutions 
correspond geometrically. 

To begin, let us determine the signs of a, 6, and c. In Fig. 2, let (f> denote the angle between 
mi — fho and m 2 — too, and let ip be the angle between i\ — %q and i 2 — %q. Notice by the law 
of cosines that 



4#oi#02 - (2#01#02 cos cpf 
4(#oi#02 sin c/)) 2 



(24) 



b = 2R 2 )1 d 2 )2 + 2-Ro2^oi ~ (2i?oi-Ro2 cos <j))(2d 01 d 2 cos tjj) 

= 2(i?oi^02 + -^02^01 ~ 2i?oi-Ro2^01^02 COS (j) COS ~ljj) (25) 

c = 4d 01 d 02 — (2rfoi^o2 cos tp) 

= 4(d 01 d 02 sin ipf (26) 

Further, \R0\R02 sin^> equals the area of the model triangle, so that a measures sixteen times 
the square of the area of the model triangle. Analogously, c measures sixteen times the square 
of the area of the image triangle. 

In what follows, I assume that the model triangle is not degenerate, that is, not simply a 
line or a point. This situation is the only time the solution is not guaranteed to exist. (For 
a discussion of this case see Section 4.5.) Note that this assumption implies that s/0 and 

From Equations 24 and 26, clearly a > and c > 0. From Equation 25, it is straightforward 
to see that b > 0: 

b = 2(i?oi^02 + -^02^01 ~ 2i?oi-Ro2^01^02 COS (/) cos ~ljj) 

> 2(Rq 1 cIq2 + -^02^01 — 2^01-^02^01^02), since cos (^ < 1, cost/; < 1 
= 2(i?oi<^o2 — -^02^01) 

> 

Returning to Equation 23, Appendix E shows that b 2 — ac > 0. From this fact and that 
a > 0, b > 0, and c > 0, we can derive that there are in general two solutions for s with a single 
special case when b 2 — ac = 0, which can be seen as follows: 



ac > =>■ b ± v b 2 — ac > 0, since b > and ac > 

6 ± \/b 2 — ac 
=^ > 0, since a > 



Hence 



lb±VF 2 



ac 



V a 

which gives one or two solutions for the biquadratic, depending on whether b 2 — ac is positive 
or equal to zero. 

Next, I show that of the two solutions for the scale, exactly one of them is valid, that is, cor- 
responds to an orthographic projection of the model points onto the image points. Furthermore, 
the other solution arises from inverting the model and image distances in Fig 2. In addition, 
there being one solution for scale corresponds to the special case in which the model triangle is 
parallel to the image plane. The following proposition, which is proved in Appendix C, will be 
useful in establishing these claims. 
Proposition 1: Let 



lb - Vb 2 - ac b + Vb 



2 



ac 



s i = \ : *2 = \ : • (27) 



Then 

si < -£-,-£- < s 2- (28) 

4.1 The true solution for scale 

Here it is shown that exactly one of the two solutions for scale can satisfy the geometry shown in 
Fig. 2, and it is always the same one. If the two solutions are the same, then both solutions can 
satisfy the geometry (this case is discussed in Section 4.3). As will be seen, the valid solution is 




Note that proving this statement establishes the existence and uniqueness of the solution given 
in Section 3. 

In Fig. 2, (si?oi) 2 - do\ = h\ > Q and (si? 2) 2 - ^02 = h\ > Q, which implies that any 
solution s for scale satisfies 

doi ^ 1 d 02 

— — < s and — — < s. 

R01 R02 

Consequently, Proposition 1 implies that S2 is the only possible solution. Still, the question 
remains whether S2 is itself a solution; the fact that it satisfies the biquadratic (Equation 22) 
is not sufficient since the steps used to derive the biquadratic from Equations 18-20 are not 
always reversible due to the squaring used to obtain Equation 21. 

Next, I show that S2 is indeed a solution by giving an assignment to the remaining variables 
that satisfies the constraints in Equations 18-20. Since (si?oi) 2 — ^01 — an d ( s Ro2) 2 — ^02 — 0> 
we can set h\ = (si?oi) 2 — ^oi an d ^2 = ( s -^02) 2 — ^025 which immediately give Equations 18 
and 19. Furthermore, we know s satisfies Equation 22, or, equivalently, Equation 21. Substitute 
h\ and h\ into the left-hand side of Equation 21: 

\h\h\ = (s\R 2 01 + R 2 02 - R\ 2 ) - (d 2 01 + d 2 02 - d 2 2 ] 

which is the same as 

±2/^2 = s 2 (R 2 01 + R 2 2 - Rj 2 ) - (d 2 01 + d 2 2 - dj 2 ). 

At this point, we are free to choose the signs of hi and h 2 . In particular, let the sign of hi 
watch the sign on the left-hand side so that 

2hih 2 = s 2 (R 2 1 + R 2 2 - R\ 2 ) - (d 2 01 + d 2 2 - d\ 2 ). (29) 

Once this choice is made, we are forced to choose the sign of h 2 to make the sign of the left-hand 
side consistent with the right-hand side. In particular, let a be the sign of /&2- Then unless the 
right-hand side is 0, 



1 if s (d 01 + d 02 - d 12 ) < R 01 + R 02 - R 12 , 
-1 if s (d 01 + d 02 - d 12 ) > R 01 + R 02 - R 12 . 



10 




On the other hand, if s 2 (R 2 2 — Rq\ — Rq 2 ) = ^12 — ^01 — ^025 then Equation 29 implies h\ or 
h 2 is 0, so that the sign of h 2 is not forced and so is arbitrary. Having chosen the sign of h 2 , 
substituting h\ and h\ into the right-hand side of Equation 29 gives 

2/^2 = h\ + h\- (s 2 R\ 2 - d\ 2 ), 

or 

which is Equation 20. 

Returning to the signs of h\ and /i2, there is two-way ambiguity in the sign of h\ which 
imposes the same two-way ambiguity on the pairs (hi,h 2 ) an d (Hi,H 2 ). As can be seen in 
Fig. 2, the ambiguity geometrically corresponds to a flip of the plane containing the space points 
mo, toi, and TO2- The flip is about a plane in space that is parallel to the image plane, but 
which plane it is cannot be determined since the problem gives no information about offsets 
of the model in the z direction. Due to the reflection, for planar objects the two solutions are 
equivalent, in that they give the same image points when projected. On the other hand, for 
non-planar objects the two solutions project to different sets of image points. 

There is a special case, as mentioned above, when the sign of h 2 is arbitrary relative to the 
sign of hi. In this case, the right-hand side of Equation 29 is zero, and this implies that hi or 
h 2 is zero also. Looking at Fig. 2, geometrically what is occurring is that one of the sides of the 
model triangle that emanates from too lies parallel to the image plane, so that the reflective 
ambiguity is obtained by freely changing the sign of the non-zero altitude. 

4.2 The inverted solution for scale 

Of the two solutions for scale that satisfy the biquadratic, we know that one of them 
corresponds to the geometry in Fig. 2, but what about the other? Using a similar argument to 
that used to prove s 2 is a solution for the weak-perspective geometry, we can infer a geometric 
interpretation for si. Consider, then, s = s\. The interpretation I will derive satisfies the 
equations, 

Hl + Rli = (rdoif (30) 

11 
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Figure 5: Geometrically interpreting the inverted solution for scale 



H2+R02 = (rd 02 
{H 1 -H 2 ) 2 + R\ 2 = (rd 12 



(31) 

(32) 



where r = -. Observe that r = — and s 2 have similar forms (see Equation 27): 



/ 


b-Vb 2 - 


- ac 


'b + VW- 


- ac 



(33) 



To begin the derivation, Proposition 1 gives that cLq X — (si?oi) > and cLq 2 — {sRq 2 ) > 0, 
which implies we can set h\ = d^ — (si?oi) 2 and h 2 = dQ 2 — (sRo 2 ) 2 . Dividing through by s 2 gives 
Equations 30 and 31. As before, since s satisfies Equation 22 and, equivalently, Equation 21, 
we can substitute into Equation 21 with h\ and h 2 to obtain 



(hi - h 2 f 



d\ 2 



s 2 /? 2 
■s n, 12 , 



where the sign of h 2 relative to hi is 1 if ^01 + ^02 — ^12 — s2 (-^oi"l"-^02 — -^12)5 an( ^ — ^ otherwise. 
Dividing through by s 2 gives Equation 32, and so the derivation is completed. 

Geometrically, Equation 30 forms a right triangle with sides Hi and R01, and hypotenuse 
rdoi. Analogously, Equations 31 and 32 imply right triangles as well. The interpretation is 
displayed in Fig. 4. Another way to see what is occurring geometrically is to note that the roles of 
image and model distances from Equations 18-20 are inverted in Equations 30-32. In effect, what 
is happening is that instead of scaling down the model triangle and projecting it orthographically 
onto the image triangle, the image triangle is being scaled up and projected orthographically 
onto the model triangle, that is, projected along parallel rays that are perpendicular to the 
model triangle. This interpretation is shown in Fig. 5 as a rotated version of Fig. 4. 
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4.3 Model triangle is parallel to the image plane 

The two solutions for the scale factor are the same when b 2 — ac = 0, and here I demonstrate that 
geometrically this corresponds to the plane containing the three model points being parallel to 
the image plane. Before proving this, let us establish the existence of the solution for scale in 
this special case of b 2 — ac = 0. Looking at Equation 23, 



ac = =>■ b ± v b 2 — ac 



is a solution to the biquadratic since a > and b > 0. 

A\ — I— lit 1-lT A\ — I— lit _1_ IT C1T1/1 

-Roi -R02 



Appendix D shows that b 2 — ac = exactly when <f> = ±ip or <f> = ±ip + ir and - 21 - — - 22 - 



Using this result and Equations 24 and 26, 




dp2 
R02 



(34) 



=^ h 1 = ^(sR^f-d 2 ^ = 
h 2 = \J(sRm) 2 ~ d 2 2 = 0. 

Thus b 2 — ac = only if the model triangle is parallel to the image plane. 

Conversely, if the model triangle is parallel to the image plane, it must be that (f> = ip. 
Further, in this case h\ = h 2 = 0, so that 



^01 _ ^02 

-Roi R02 



(35) 



which from Appendix D implies that b 2 — ac = 0. 

Since the two solutions are the same, we know that si = S2 = -. Notice in Figs. 3 and 4 
that the geometric interpretations for the two solutions for scale collapse to the same solution 
when h\ = h,2 = H\ = H 2 = and s = -. As a result, when there is one solution for scale, 
there is also one solution for (/ii,/^) an( i (-Hi 5-^2)5 albeit (0,0). 

4.4 Model triangle is perpendicular to the image plane 

The situation where the model triangle is perpendicular to the image plane is of interest since 
the projection is a line. Note, however, that the solution given earlier makes no exception for 
this case as long as the model triangle is not degenerate. As for what happens in this case, 
since the image triangle is a line, we know ip = =>■ c = =>■ Equation 23 becomes 

(36) 
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sm ? 



sm 2 



Figure 6: Special case where model triangle is a line. The repeated labels correspond 
to two different solutions for the position of the model that leave sm\ projecting onto 
i\. For both solutions sm^ projects onto the same image point. 



As shown above, of the two solutions for scale, the true one is \ — and the inverted one is 0. 

To see why the inverted solution is zero, recall that the solution can be viewed as scaling 
and projecting the image triangle onto the model triangle, using for scale r = -, which in this 
case does not exist. Since the image triangle is a line, graphically this amounts to trying to 
scale a line so that it can project as a triangle, which is not possible. 

4.5 Model triangle is a line 

This is the one case where the solution for the scale fails, and it fails because a, which is 
a measure of the area of the model triangle, is zero. Despite this fact, we can determine 
when a solution exists. First, we know that the image triangle must be a line as well. To 
see if this condition is enough, consider looking for a 3D rotation and scale that leaves srrii 
orthographically projecting onto i\ as in Fig. 6. Observe that every such rotation and scale 
leaves sm^ projecting onto the same point in the image. This means is that for a solution to 
exist, it must be that 



Roi 



do2 

Ro2 



Even when the image triangle is a line, this in general is not true. When it is true, there is an 
infinity of solutions corresponding to every scaled rotation that leaves sm\ projecting onto i\. 

Another way to look at this situation is to notice that the model triangle being a line when 
using the true solution is analogous to the image triangle being a line when using the inverted 
solution, where the roles of the model and image triangles are reversed. As discussed in the 
previous section, the image triangle is a line when the model triangle is perpendicular to the 



14 



image plane. The analysis there reveals that for the inverted solution the scale factor r is 
undefined, which means that here the true solution for the scale factor s is undefined as well. 

4.6 Summary 

Our goal was to determine the three unknown parameters of the geometry displayed in Fig. 3, 
namely s, hi, and hi- The figure gave three constraints (Equations 18-20), from which a 
biquadratic in the scale factor s was derived. The biquadratic always has two positive solutions, 
and its coefficients, a, b, and c, are all non-negative. Of the two solutions, Section 4.1 showed 
that one and only one can satisfy the three constraints, and that solution is s = S2 from 
Proposition 1 (see Equation 27). Given s, there are two pairs of valid assignments for hi and 
/&2- They correspond to reflecting the plane of the three matched model points about any plane 
parallel to the image; all planes parallel to image plane are equally-good. This proved that the 
solution for 3D pose exists and is unique up the reflective ambiguity. 

In Section 4.2, Proposition 1 was used to infer the geometry that gives rise to the other 
solution to the biquadratic, namely s = s\ (Equation 27). This solution, which is illustrated in 
Fig. 5, is obtained by inverting the roles of the model and image points in Fig. 3. The difference 
with the inverted solution is that the image points are being scaled and then orthographically 
projected onto the model points, instead of the reverse. The inverted geometry satisfies three 
constraints, Equations 30-32, that parallel the true constraints in function and form. Similarly, 
the expression for the scale factor of the inverted solution, r = — (Equation 33), parallels the 
expression for the true scale factor, s = S2- 

Three special cases were discussed next, one in which the plane of the matched model points 
is parallel to the image plane (Section 4.3), one in which it is perpendicular to the image plane, 
or, equivalently, in which the matched image points are collinear (Section 4.4), and one in which 
the matched model points are collinear (Section 4.5). The first case is the one and only situation 
in which the two solutions collapse to the same one, and in this case hi = hi = 0. In addition, 
this situation is exactly where the two solutions to the biquadratic are the same; this is seen 
geometrically by looking at Figs. 3 and 4 with hi, h^, Hi, and if 2 all zero and s = si = $2 = - ■ 

In the case where the matched image points are collinear, the solution for 3D pose is still 
valid. It is interesting to note, however, that the inverted solution for the scale factor does not 
exist. Yet the inverted solution for the scale does exist when the model points are collinear, but, 
in this case, the true solution does not. Section 4.5 determined that when the model points are 
collinear a solution for 3D pose may still exist, but if and only if a further constraint is satisfied. 
The section concludes by giving the constraint and describing how it arises geometrically. 

5 Image Position of a Fourth Model Point 

To compute the position in the image of a fourth model point, I first use the solution from 
the previous section to compute its 3D position in camera-centered coordinates. By so doing, 
I can project the camera-centered model point under weak-perspective and obtain the image 
position without having to calculate a model-to-image transformation. Let the image points be 
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i = (2:0,2/0); i\ = (2:1,2/1), and i 2 = (2:2,2/2)- Given s, hi, hi, we can invert the projection to 
get the three model points: 





1, 






too = 


= -{X . 
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.2/0; 
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rn~i - 


1, 

= -(xi- 
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.2/1; 


,/il + w) 


777*2 = 


1, 

= -(^2- 

s 


.2/2; 


/i2 + w), 



where w is an unknown offset in a direction normal to the image plane. 

Given three 2D points, q~o, q[, and q 2 , a fourth 2D point q 3 can be uniquely represented by 
its "affine coordinates," (a, (3), which are given by the equation 

q 3 = a (qi - q ) + [i(q 2 - q ) + go- 
Given three 3D points, pl, pl, and pl, this representation can be extended to uniquely represent 
any other 3D point pl in terms of what I shall call its "extended affine coordinates," (a, (3, 7), 
as follows: 

pl = a (pi - pl) + /3(pl - pl) + 7 (pi - pl) X (pi - pl) + pl (37) 

Let 

£oi = xi - x , 2/01 = 2/1 - 2/0, 

£02 = x 2 - x , 2/02 = 2/2 - 2/o- 

Then, using the three model points with pl = mo, pi = mi, and pi = 7?7*2, 





P1-P0 = 


= -(£01,2/01, M 






(38) 




pl - Po = 


= -(X02,y02,h 2 ) 






(39) 


(pi - 


- Po) x (pl - pl) = 


= -7(2/01^2 - Vmhi,xo 2 hi - 


- x ih 2 ,x iyo2 - 


- £022/01) . 


(40) 



Next, substitute Equations 38-40 into Equation 37 to get the three-space location of the fourth 
point: 

m 3 = -a(x i, 2/01, hi) + -f3(x 02 , 2/02, h 2 ) 

+7 — (2/01 ^2 - Vmhi,-xoih 2 + xo 2 hi,xoiVo2 ~ £022/01) + -(x ,y ,w) 

1 / . „ . 2/oi/i2 - 2/02/ii . 

= -(aa; i + P2: 2 +7 1" xo, 

s s 

-x ih 2 + x 02 hi 

«2/oi + P2/02 + 7 1" 2/0, 

s 

/,,«/,, ^012/02 - £022/01 . x ,.-.>. 

ahi+/3h 2 +j |-w) (41) 
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To project, first apply the scale factor s: 

Voih 2 ~ Vmh\ 



srriz 



(ax 01 + f3x 02 + 7 : 
ayoi +/3y 2 + 7" 



-x ih 2 + x 02 h\ 



ahi + (3h 2 + 7 



£012/02 



s 
- x 02 y 01 



Xq, 



2/o, 



w) 



(42) 



Let II represent an orthogonal projection along the z axis. Then project orthographically to 
get the image location of the fourth point: 

n(sm 3 ) = (ax 01 + f3x 02 + ~f(y 01 H 2 - y 02 H 1 ) + x , 

ayoi + liym + l{-x 01 H 2 + x 02 H 1 ) + y ) (43) 

Notice that the unknown offset w has dropped out. This expression computes the image position 
of p*3 from its extended affine coordinates, from the image points, and from Hi and H 2 , the 
altitudes in the weak-perspective geometry. There are no intermediate results about the actual 
3D pose stored along the way, and as a result, this computation should be very efficient. 
Nonetheless, it should be kept in mind that Hi and H 2 depend on the specific imaging geometry; 
that is, they depend on the pose of the model. 

It may be worthwhile to observe that Equation 43, the expression for the fourth point, can 
be rewritten as a weighted sum of the three image points: 

n(sm 3 ) = (ax i + [ix 02 + 7(2/0 1-^2 - 2/02 #1) + %o, 
ayoi + liym + -y(-x iH 2 + x 02 Hi) + y ) 

= (axi +jH 2 yi,ayi - "{H 2 x x ) - (ax + jH 2 y ,ay - -yH 2 x ) + 
{fix 2 - "fH 1 y 2 ,(ly 2 +jH 1 x 2 ) - (fix - 'yH 1 y ,^y + jH 1 x ) + 

(xo,yo) 



1- a- (i 7(#i-# 2 ; 
- 7 (#i -H 2 ) 1 - a - (3 



a ^H 2 
- r fH 2 a 



X\ 

Vi 



Xq 

. y ° 

(i -~iH x 
1 H 1 (3 



x 2 

V2 



Let Rg represent a 2D rotation matrix that rotates by an angle 9. Then 

U(sm 3 ) = S Kg i + S 1 Kg 1 i 1 + S 2 Kg 2 i 2 , 
where 

£0 = ^(l-a-/3) 2 + (7(#i-#2)) 2 
Si = \jo? + ( n H 2 f 
S 2 = ;//3 2 + ( 7 #i) 2 



(44) 

(45) 
(46) 
(47) 
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cos0Q = l^l sin o= Zl(^LzM 

cos^ = |° sm^ = ^° (48) 

cos 6 2 = j- sin 62 = -y^- 

Thus, we can view the computation as a 2D rotation and scale of each image point separately 
followed by a sum of the three. It is important to keep in mind, however, that the rotations 
and scales themselves depend on the image points, because of Hi and Hi- 

When the model is planar, the form of Equation 44 facilitates understanding the effects 
of error in the image points. Error in the locations of the matched image points leads to 
uncertainty in the image location of the fourth model point. Suppose that the true locations of 
the matched image points are known to be within a few, say e 8 -, pixels of their nominal locations, 
for i = 0,1,2. Let i{ and c 8 - be the true and nominal locations of an image point, for i = 0,1,2. 
Then, for some e$, *o = c*o + e*o 5 where || e*o ||= e o 5 an d similarly for i\ and ii- Then 

U(sm 3 ) = S Kg i + S 1 Kg 1 i 1 + 62^0^2 

= (SoTLg c* + S 1 Kg 1 c{ + S 2 'Rg 2 c r 2) + (<5 Re eo + S 1 Kg 1 e{ + S 2 'Re 2 e*2) 

When the fourth point is in the plane of the first three, 7 = 0, so that the scales, So, Si, and S2, 
and 2D rotations, R# n , Rg 1 , and R# 2 , are all constant (see Equations 45-48). This means that 
the first term in parentheses is just the nominal image location of the fourth model point. Since 
e"o, e[, and €2 move around circles, the 2D rotations in the second term can be ignored. Further, 
since these error vectors move independently around their error circles, their radii simply sum 
together. Therefore, the region of possible locations of the fourth model point is bounded by a 
circle of radius Sq€q + S\€i + ^2^2 that is centered at the nominal point. By plugging 7 = into 
Equations 45-47, we get that 

S = \l-a-(3\, S 1 = \a\, S 2 = |/3| , 

Assuming e = e x = e 2 = e, this implies that the uncertainty in the image location of a fourth 
point is bounded by a circle with radius (|1 — a — (3\ + |a| + |/3|)e and with its center at the 
nominal point, which repeats the result given earlier by Jacobs [19]. 

Although the non-planar case clearly is more complicated, since the scales and 2D rotations 
are no longer constant, Equation 44 may prove useful for obtaining bounds on the effects of 
error in this situation as well. 

6 Stability of the 3D Pose Solution 

In numerical computations, it is well-advised to determine whether a computation is stable, 
since, if not, it could produce inaccurate results. A computation is unstable if any roundoff 
error can propagate and magnify such that the true answer is significantly altered. The most 
common source of roundoff error is known as catastrophic cancellation, where two numbers of 
nearly equal magnitudes and opposite signs are summed. In fact, catastrophic cancellation is 
the only way a sudden loss of precision can occur [31]. Otherwise, in general precision can be 
lost by an accumulation of small errors over several operations. 
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In the 3D pose solution, there are a few subtractions of positive numbers to be wary of. In 
computing hi and hi from s (Equation 7), the values of h\ and hi may have little precision if 
cancellation occurs in the radicands, in which case h\ or hi will be small relative to its range 
of values. As discussed at the end of Section 4.1, h\ or hi is zero when one of the sides of the 
model triangle that emanates from too lies parallel to the image plane. 

The calculation of h\ and hi can also be unstable if s is inaccurate. Looking at Equation 6 
and recalling that a, b, and c are non-negative, catastrophic cancellation can only occur in the 
inner radicand. Even if it does, this is not a problem, since the result of the square root would 
be negligible when added to b. 

Another way for s to become inaccurate is if the value of a, b, or c in Equation 6 is obtained 
with little precision. For a and c, Equations 9 and 11 show in parentheses one of the sides of 
a triangle being subtracted from the sum of the other two; therefore, catastrophic cancellation 
may occur when the triangle is nearly a line. Equation 10 shows that cancellation may occur 
in computing b if either the terms in parentheses or the total sum approaches zero relative to 
their ranges of values. From the law of cosines, the terms in parentheses are near zero when 
some angle of the model triangle is small. From Equation 25, the total sum, i.e., b, is small 
only if certain angles in the model and image triangles are small also. This says we should be 
careful of b in the same circumstances in which we are careful of a and c, namely, when the 
model or image points are nearly collinear. 

To conclude, the parameters s, hi and hi (or s, Hi, and H2) are prone to instability when 
the matched model or image points are almost collinear, and, additionally, Hi or Hi can be 
unstable when one of the vectors from too to ih\ or rhi is nearly parallel to the image. In the 
latter case, the unstable Hi or Hi is close to zero. If only one of Hi and Hi is close to zero, 
then the instability can be avoided by re-ordering the matched points to make both Hi and 
H.2 large. However, if this is done, the difference H.\ — Hi will be close to zero and may be 
imprecise. If both H.\ and Hi are almost zero, which means the model triangle is nearly parallel 
to the image, then re-ordering the matched points will not help. 

Finally, it is worth observing that much of the instability in the pose solution occurs at 
places in which the problem is ill conditioned, that is, places where instability is inherent in 
the geometry. For instance, Hi was said to be unstable when the vector from too to mi is 
nearly parallel to the image. Geometrically, in this situation a small change in the position of 
i\ can cause a large change in the altitude H\ (Fig. 2). For the same reason, recovering the 
altitude Hi is unstable when the vector from too to rhi is nearly parallel to the image. This 
situation would be worse if both vectors emanating from too were parallel to the image. By 
a similar argument, it is intrinsically unstable to recover the pose when the model points are 
nearly collinear, due to there being an infinity of solutions when the model points are exactly 
collinear (Section 4.5). 

This suggests that recognition systems like alignment and pose clustering should give special 
attention to situations where the model triangle is almost a line and where the model triangle 
being viewed straight on. These cases could be avoided by checking if the model points are 
nearly collinear or if the corresponding angles between the model and image points are very 
close. For the latter case, the suggestion does not apply if alignment is being used to recognize 
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planar models. This is because, if Equation 14 is used, error in Hi or Hi has no effect on the 
image locations of points in the plane, since for these points 7 = 0. 

7 Review of Previous Solutions 

There have been several earlier solutions to the weak-perspective three-point problem, notably 
by Kanade and Render [20], Cyganski and Orr ([7], [8]), Ullman ([28], [17]), Huttenlocher 
and Ullman ([16], [18], [29]), and Grimson, Huttenlocher, and Alter [12]. All the previous 
solutions compute the 3D pose by going through a 3D rigid transformation or a 2D afhne 
transformation relating the model to the image. A 2D afhne transform is a linear transform 
plus a translation, and it can be applied to any object lying in the plane. All but Ullman's 
and Grimson, Huttenlocher, and Alter's solutions compute an afhne transformation between 
the three model and image points. Also, all but Kanade and Render's solution compute a 
model-to-image rigid transformation, either via a rotation matrix or via Euler angles. 

Not all of the solutions directly solve the weak-perspective three-point problem. The earliest 
solution, which was given by Kanade and Render in 1983, applies Ranade's skewed-symmetry 
constraint to recover the 3D orientation of a symmetric, planar pattern [20]. More precisely, 
Ranade and Render showed how to compute the 3D orientation of the plane containing a 
symmetric, planar pattern from a 2D afhne transform between an image of the pattern and 
the pattern itself. To apply this result to the weak-perspective three-point problem, the three 
points can be used to construct a symmetric, planar pattern, and a 2D afhne transform can be 
computed from two sets of three corresponding points. The solution was shown to exist and to 
give two solutions related by a reflective ambiguity, assuming that the determinant of the afhne 
transform is positive. 

The remaining methods all concentrate on computing the 3D rigid transform from the model 
to the image. In 1985, while presenting a system for recognizing planar objects, Cyganksi and 
Orr showed how to use higher-order moments to compute a 2D afhne transform between planar 
regions ([7], [8]). Given the afhne transform, they listed expressions for computing the 3D 
Euler angles from the 2D afhne transform 1 . They did not, however, discuss how they derived 
the expressions. 

The next method is the solution given by Ullman in 1986 [28], which appeared again in [17]. 
The paper included a proof that the solution for the scale factor is unique and the solution for 
the rotation matrix is unique up to an inherent two-way ambiguity. (This corresponds to the 
ambiguity in H.\ and H2) But Ullman did not show the solution exists. When it does exist, 
Ullman described a method for obtaining the rotation matrix and scale factor. 

In 1988, Huttenlocher and Ullman gave another solution, and, in the process, gave the 
hrst complete proof that the solution both exists and is unique (up to the two-way ambiguity) 
([16], [18], [29]). Like Ranade and Render, and Cyganski and Orr, Huttenlocher and Ullman's 
solution relies on a 2D afhne transform. The solution itself is based on algebraic constraints 
derived from rigidity, which are used to recover the elements of the scaled rotation matrix. 



The expressions that appear in [7] contain typesetting errors, but are listed correctly in [8]. 
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The last solution, which was published this year, was developed by Grimson, Huttenlocher, 
and Alter for the purpose of analyzing the effects of image noise on error in transformation 
space [12]. Towards this end, the method facilitates computing how a small perturbation in 
each transformation parameter propagates to uncertainty ranges in the other parameters. 

8 Presentation of Three Previous Solutions 

The solutions discussed in the previous section differ significantly in how they compute the 
transformation, and, as a result, each one can provide different insights into solving related 
problems, such as error analysis in alignment-based recognition and pose clustering. It seems 
useful, then, to present the previous solutions in detail, so they conveniently can be referred to 
and compared. 

The first method presented is Ullman's solution, which the first part of this paper extended. 
After that, I give Huttenlocher and Ullman's solution. Lastly, I present the method of Grimson, 
Huttenlocher, and Alter. I do not present Kanade and Render's method nor Cyganski and Orr's, 
because Kanade and Render did not directly solve the weak-perspective three-point problem, 
and Cyganski and Orr did not detail their solution. 

It should be pointed out that the presentations here differ somewhat from the ones given 
by the original authors, but the ideas are the same. Basically, the presentations emphasize the 
steps that recover the 3D pose while being complete and concise. For more details, the reader 
is referred to the original versions in the references. 

In the following presentations, we are looking for a rigid transform plus scale that aligns 
the model points to the image points. In all methods, we are free to move rigidly the three 
image points or the three model points wherever we wish, since this amounts to tacking on an 
additional transform before or after the aligning one. For example, this justifies the assumption 
made below that the plane of the model points is parallel to the image plane. 

For consistency, the same notation as in Sections 3 and 4 is used in the proofs that follow: 
Let the model points be too, mi, m^ and the image points be %q, ii, ii, with the respective 
distances between the points being i?oi, -R02, an d R12 for the model points, and c?oi, <^02, an d 
di2 for the image points. 

8.1 Overview 

This section provides an overview of the three methods. 

Initially, all three methods compute a transformation that brings the model into image 
coordinates, such that the plane of the three matched model points is parallel to the image 
plane and such that mo projects onto %q, which has been translated to the origin. The three 
methods then compute the out-of-plane rotation and scale that align the matched model and 
image points. In so doing, the methods all end up solving a biquadratic equation. 

In Ullman's method, the model and image points are further transformed via rotations 
around the z axis to align rh\ and i\ along the x axis. Then the 3D rotation matrix for rotating 
successively around the x and y axes is expressed in terms of Euler angles. This leads to a 
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series of three equations in three unknowns, which are solved to get a biquadratic in the scale 
factor. To get the elements of the rotation matrix, the solution for scale factor is substituted 
back into the original three equations. 

Instead of further rotating the model and image points, Huttenlocher and Ullman compute 
an affine transform between them, which immediately gives the top-left sub-matrix of the scaled 
rotation matrix. Then by studying what happens to two equal-length vectors in the plane, a 
biquadratic is obtained. The scale factor and the remaining elements of the scaled rotation 
matrix are found using the algebraic constraints on the columns of a scaled rotation matrix. 

Like Ullman did, Grimson, Huttenlocher, and Alter rotate the model further to align mi 
and i\. The desired out-of-plane rotation is expressed in terms of two angles that give the 
rotation about two perpendicular axes in the plane. Next, Rodrigues' formula, which computes 
the 3D rotation of a point about some axis, is used to eliminate the scale factor and obtain two 
constraints on the two rotation angles. The two constraints are solved to get a biquadratic in 
the cosine of one of the angles. Its solution is substituted back to get the other angle and the 
scale factor, which can be used directly by Rodrigues' formula to transform any other model 
point. 

As mentioned in the introduction, Ullman's solution is incomplete because it does not show 
which of the two solutions for the scale factor is correct; actually, the solution is completed by the 
result given in Section 4.1 of this paper. Similar to Ullman's method, Grimson, Huttenlocher, 
and Alter's solution has the same drawback of not showing which solution to its biquadratic is 
correct. Huttenlocher and Ullman, on the other hand, have no such problem because it turns 
out that one of the two solutions to their biquadratic is obviously not real, and so it immediately 
is discarded. 



8.2 Ullman's method 

This section gives Ullman's solution to the weak-perspective three-point problem. The main 
idea is first to transform the three model points to the image plane and then solve for the scale 
and out-of-plane rotation that align the transformed points. 

Specifically, the model points first are rigidly transformed to put the three model points in 
the image plane with too at the origin of the image coordinate system and rh\ — rfiQ aligned with 
the x axis. After rigidly transforming the model points, the resulting points can be represented 
by (0,0,0), (aTi,0,0), and (a^, 2/2,0). Similarly, let the image points be rigid transformed to 
put iq at the origin and i\ — %q along the x axis, and let the resulting image points be (0, 0, 0), 
(2:i,0,0), and (2:2,1/2,0). 

Next, we break the out-of-plane rotation into a rotation around the x axis by an angle 9 
followed by a rotation around the y axis by an angle (f>, as pictured in Fig. 7. The corresponding 
rotation matrix is 



R 



cos (f> sin (f> 

1 

— sin (f> cos (f> 



1 

cos 9 — sin ( 
sin 9 cos 9 
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Figure 7: Interpreting the out-of-plane 


rotation angles in Ullman's method. 



cos (f> sin (f> sin sin (f> cos ( 
cos — sin 

— sin <^> cos (f> sin # cos <^> cos i 



(49) 



After rotation and scale, (0,0,0), (aTi,0,0), and (x~2,y~2,Q) become (0,0,0), (xi,0,zi), and 
{x2,y2,Z2), respectively, where z\ and Z2 are unknown. Thus, we need to find 0, (f>, and s 
such that 

sR(aTi,0,0) = (xi,0,zi) 

sK(x 2 ,y 2 ,0) = (x2,y2,z 2 ) 

Expanding the first two rows of R yields three equations in three unknowns: 

sx\ cos (f> = xi (50) 

sy 2 cos = y 2 (51) 

sx~2 cos (f> — sij2 sin (f> sin = X2 (52) 

Fig. 7 gives a graphical interpretation of the first two equations. Substituting Equations 50 
and 51 along with expressions for sin^> and sin into Equation 52 yields a biquadratic in the 
scale factor s: 



where 



as 

a 
b 
c 



bs 2 + c = 0, 



- 2 - 2 

xi y 2 

2/ - 2 

x 1 (x 2 

2 2 

XiV 2 



V2 



-2/2 

= 1 (x 2 



vl) 



i lX\X2X\X2 



The positive solutions for s are given by 



lb±Vb 2 -Aac 
2a 



(53) 

(54) 
(55) 
(56) 

(57) 
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In general there can be one, two, or no solutions for s. Ullman makes no further attempt to 
determine when or if each solution arises, except to refer to a uniqueness proof he gives earlier 
in the paper. The uniqueness proof implies there can be at most one solution for s, but does 
not say which solution it is or whether it can be either one at different times. 

Given s, the rotation matrix R is obtained using cos d> = -^- and cos = -^?- in Equation 49. 

" ° r sx\ sy2 ^ 

One difficulty with this is that we do not know the signs of sin and sin (f>; this leaves four 
possibilities for the pair (sin 0, sin (f>). In his uniqueness proof, Ullman points out that the 
inherent reflective ambiguity corresponds to multiplying simultaneously the elements 7*13, 7*23, 
7"3i, and r32 of R by — 1. In Equation 49, the signs of those elements also are inverted when 
both sin# and sin^> are multiplied by —1, which, visually, corresponds to reflecting the model 
points about the image plane (Fig. 7). Still, we have no way to know which of the two pairs of 
solutions is correct. One way to proceed is to try both and see which solution pair aligns the 
points. 



8.3 Huttenlocher and Ullman's method 

First, assume the plane containing the model points is parallel to the image plane. Then 
subtract out tbo and %q from the model and image points, respectively, to align them at the 
origin. Let the resulting model points be (0,0,0), ( £1,7/1,0), and (a^, 2/2,0), and the resulting 
image points be (0, 0), (x\, 7/1), and (2:2, 2/2)- At this point, what is left is to compute the scaled 
rotation matrix that brings (x\, 7/1, 0) and (a^, 2/2, 0) to (x\, 7/1, z\) and (2:2, 7/2, z 2 ), respectively, 
where z\ and z 2 are unknown. That is, we need 



sR(a;i, 7/i,0) 
sK(x 2 , 7/2,0) 



[xi, yi,zi) 



Letting In = srn, l\ 2 = sr\ 2 , etc., and focusing on the first two rows of the rotation matrix, 
we get two sets of equations: 

(58) 
(59) 



(60) 
(61) 



hixi + /122/1 = 


= X\ 


hix~2 + hiVi ~- 


- x 2 


h\x\ + I22H1 ~- 


= 2/1 


h\x 2 + I22H2 ~- 


= 2/2 



which give 



, the top-left sub-matrix of the scaled rotation matrix. Note that this 



^11 ^12 

hi hi 
step fails if the determinent, xiy 2 — x 2 yi, equals zero. 

Next, we make a digression to consider what happens to two orthogonal, equal- length vectors 
in the plane, e[ and e 2 . Since e[ and e 2 are in the plane, we can apply the sub-matrix just 
computed to obtain the resulting vectors, e[' and e 2 : 



ei 



hi 
hi 



I12 
hi 



ei, 



e 2 



hi 
hi 



I12 
hi 



e 2 



(62) 
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Figure 8: Projecting two orthogonal same-length vectors in Huttenlocher and Ullman's 
method. 



When a model is transformed, el and e~2 undergo a rigid transformation plus scale before 
projection. As shown in Fig. 8, after transformation these vectors become e[' -\-c\z and €2 -\-c2z. 
Since a scaled, rigid transform preserves angles and ratios of lengths between vectors, and since 
e[ ■ e* 2 = and || e[ || = || €2 ||, it must be that 

(el' + ciz) ■ (eV + c 2 z) = 



+4 



+4 



II e l II + C 1 =11 e 2 

These two equations simplify to 



cic 2 



^2 



where 



k 2 



-el' • e"^' 



e2 



ei 



Substituting for C2 = -*- in the second equation leads to a biquadratic in c\\ 



>'i 



c| - k 2 cj -kj = 
The general solution is 

± 



(63) 
(64) 

(65) 



c\ 




k 2 ± ^k\ + Ak\ 



Conveniently, the inner discriminant always is greater than or equal to zero. Furthermore, since 
Ak\ > 0, the real solutions are given by 



ci = ± 



^ (*2 + >/*f+4^) , 



(66) 
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since otherwise the outer discriminant is less than zero. 

These two solutions for c\ give two corresponding solutions for C2, which from Fig. 8 can be 
seen to correspond to a reflection about the image plane. 

The solution for ci does not work when c\ = 0. In this case, 



C2 



±s/=h = ±y/\\e['\\- || e^' || . (67) 



This gives two solutions for C2, if it exists, which can be seen as follows. Since c\ = 0, e{ ends 
up in the plane, so that that the length of e{ is just scaled down by s, whereas the length of 
e*2 reduces both by being scaled down and by projection. Consequently, || e^' \\<\\ e[' ||, and, 
therefore, ci exists. 

Given c\ and C2, we can recover two more elements of the scaled rotation matrix. Since e*i 
and e*2 are in the plane, we know that sRe*i = e[' + c{z and sRe*2 = e^' + c^z. Focusing on the 
last row of the scaled rotation matrix, we get the two equations /31 = c\ and l^i = ci- 

At this point, we have the first two columns of sR, and, from the constraints on the columns 
of a rotation matrix, we can get the last column from the cross product of the first two. In 
total, this gives 



sR 



hi h2 7(^2/21 - ci/22) 
hi I22 \{cih2 ~ c 2 /n) 

Cl C 2 i(/n/ 2 2 - ll2hl) 



(68) 



Since the columns of a rotation matrix have unit length, we know 

* = \Jl\i + 111 + A = \j\\i + \\i + 4 ■ (69) 

Notice that the ambiguity in c\ and ci inverts the signs of the appropriate elements of the 
rotation matrix as discussed in Section 8.2. 

8.4 Grimson, Huttenlocher, and Alter's method 

Grimson et al. gave another solution to the weak-perspective three point problem in order to 
get a handle on how small perturbations affect the individual transformation parameters. 

To start, assume the plane containing the model points is parallel to the image plane. Next, 
rigidly transform the model points so that ttiq projects to %q and rfii — rfiQ projects along ii — iQ. 
Let II represent an orthogonal projection along the z axis, and in general let v 1 - be the 2D 
vector rotated ninety degrees clockwise from the 2D vector v. Then the translation is %q — Ilmo, 
and the rotation is about z by an angle ip given by 

cos ip = tooi • ioi, sin ip = — moi • «oi- 

(see Fig. 9). 

At this point, assign tooi = in\ — mo, ^02 = ^2 — "^o, ^01 = h — ^o 5 an d io2 = ^2 — ^o- 
Also, consider the out-of-plane rotation to be a rotation about ioi by some angle 9 followed by 
a rotation about Iq X by some angle <f>. Let us compute where the vectors ioi an d i^ project to 
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ka i 




Figure 9: After the rotation by ip in Grimson, Huttenlocher, and Alter's method, the 
plane of the model points is parallel to the image plane, too projects onto io, and mi — mo 
projects along i\ — %q. 



after the two rotations and scale. To do this, we use Rodrigues' formula: Let R~ p represent 
a rotation of a point p about a direction v by an angle r. Rodrigues' formula is 

R~ p = cosrp + (1 — cos t)(v ■ p)v + sin t(v X p). (70) 

Using the formula, we can compute 

cos 4>iqi — sin (f>z (71) 

sin 6 sin <f>iQ\ + cos 6i 01 + sin 6 cos <f>z. 



R^j_ ,R^ iq\ 

?_L 



Initially, raoi was rotated about z to align it with ioi- In order for the scaled orthographic 
projection of toqi to align with ioi 5 Equation 71 implies that 



im 



1 



|| TOqI || COS(j) 

d 01 1 



i?01 COS (f) 



Then 



SnR ^,^ R ?0i/01 



dpi 

Roi 
d i 



1 



-(sin 6 sin ^oi + cos ^ 01 ) 



(721 



f73) 



(74) 



i?01 COS (^> 

Next, we use the expressions in Equations 73 and 74 to constrain 9 and <^> such that TO02 
projects along io2- When we aligned tooi and ioi 5 "^02 rotated to R-^ ,too2- Since TO02 has no £ 
component (by assumption), we can represent R-^ ,too2 by 

R 02 cos £i i + R02 sin ^ , 



27 



where £ is a known angle. Consequently, the transformed, projected, and scaled mo2, which 
must equal io2 5 is 

slTR^ % (#02 cos £i i + -R02 sin £i£i) 

= #02 cos £(sIIR ? j. ^R ?oi /01 ) + #02 sm ^IIR^ ^R ?qi ~i^ ) 

= #02 cos £ ( -^-ioi ) + #02 sin £ ( -^- -(sinflsin^oi + cosOi^) 

V-R01 / \R i cos cf) 

^01 #02/ t 1 . . t . , . av , ^01 #02/ . t ovl 

= -— — (cos 4 cos <p + sm £ sm <p sm #hoi H -— — (sin( cos tm 01 . 

cos <p Rqi cos <p Rq\ 

Similar to R^ ,mo2, we can represent io2 as 

io2 = d 02 cosijjiQi + d 2sino;ioi5 
where uj is known. By equating terms we get 
^01 #02 



(cos £ cos (^ + sin £ sin (^ sin 0) = cos^coscj (75) 

sin £ cos 9) = cos^sinw. (76) 



dm #01 

doi #02 



do2 R01 
These two equations can be solved to get a biquadratic in cos (f>: 

sin to cos <f> — (t + 1 — 2icosw cos£) cos <f>-\-t sin £ = 0, (77) 

where 

t = ^l. (78) 

#01"02 

Since R^ ,tooi is aligned with ioi 5 we need cos^ to be positive so that tooi projects in the same 
direction as ioi- The positive solutions are given by 



cos <f> = -\lv ± \lv 2 — t 2 sin 2 w sin 2 £ (79) 

I sin a; I V v 

with 

v=—(l-\-t — 2icoswcos£). 

This equation gives up to two solutions, but Crimson et al. make no further attempt to show 
which solutions exists when, except to say the equation gives real solutions only if v > or 

1 + t 2 
coscjcos£< . (80) 
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Given (f>, Equations 75 and 76 provide 9: 

sin oj cos d> 

cos 9 = -— (81) 

t sin £ K J 

cos d>( cos oj — t cos f) 

sin 9 = . , . , — (82) 

t sin 4 sin r 

Given any model point to, we can use the computed angles along with Rodrigues' formula 
to find its image location. In particular, once too and %q have been subtracted out, only the 
scale and 3D rotation are left. The scale is given by Equation 72, and, as shown above, the 
rotation is 

R^i , Iv> ,R" ,. (83) 

As with Ullman's method (Section 8.2), we do not know the signs of sin# and sin^>, but only 
that inverting both signs simultaneously corresponds to the reflective ambiguity. 

8.5 Summary of the three computations 

Here I summarize how each method can be used to compute 3D pose from three corresponding 
points. To begin, transform the model and image points so that (1) the model points lie in the 
image plane, (2) too and %q are at the origin of the image coordinate system, and (3) mi — too 
and i\ — %q lie along the x axis. Then use one of the three methods to compute the scale factor 
and out-of-plane rotation, as follows: 

• Ullman's method 

1. Use Equations 54-56 to get a, 6, and c. 

2. Substitute a, 6, and c into Equation 57 to get s. 

3. Calculate cos d> = -^- and cos 9 = -^?-. 

r sx! sy 2 



4. Calculate sin <f> = \Jl — cos 2 <f> and sin 9 = \/l — cos 2 9. 

5. Construct the rotation matrix R using Equation 49. 

• Huttenlocher and Ullman's method 

1. Solve Equations 58 and 59 for In and /12, and Equations 60 and 61 for /21 and £22- 

2. Let e"i = (0,1) and €2 = (1,0). (Any orthogonal, equal-length vectors can be used.) 

3. Use Equation 62 to get e[ and €2 ■ 

4. Substitute e[' and e^' into Equations 63 and 64 to get k\ and ki- 

5. Substitute h\ and ki into Equation 66 to get c\. 

6. If c\ 7^ 0, calculate c^ = - L . Otherwise get c^ from Equation 67. 

7. Use Equation 69 to get s. 
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8. Use Equation 68 to get sR. Divide through by s if R is desired instead of sR. 
• Grimson, Huttenlocher, and Alter's method 

1. From the model points, compute Rq\, R02 an d £, and, from the image points, com- 
pute doi, do2, and u. 

2. Use Equation 78 to get t. 

3. Use Equation 79 to get coscj). 

4. Use Equation 72 to get s. 

5. Calculate sin <f> = \Jl — cos 2 <f>. 

6. Use Equations 81 and 82 to get cos# and sin 0. 

7. To transform any point p, substitute coscj), sin^>, cos 0, sin 0, and p into Rodrigues' 
formula, Equation 70, to get Rp = R-> ± ,R-> „p. 

9 Stability and Comparison of Three Previous Solutions 

For computing 3D pose, it is desirable to know how the solutions compare in terms of stability. 
To address this issue, let us examine how susceptible the solutions are to catastrophic cancella- 
tion [31]. For ease of reference, I will indicate which steps in the pose computation summaries 
of Section 8.5 may be unstable. 

Ullman's solution computes s in the same way as this paper does, and, as a result, is unstable 
at the same places (see Section 6). For instance, precision may be lost if the model or image 
points are nearly collinear when computing the coefficients, a, b, and c, of the biquadratic. (In 
Section 8.5, this is step 1 of Ullman's solution.) Looking for a moment at Ullman's computation 
of a and c, it may appear that the computation is stable since there is no addition in Equation 54 
or 56. In actuality, instability is hidden in the initial transformation that aligns the model and 
image with the x axis. 

Given s, Unman computes the cosines of the angles and (f> and then implicitly uses 
\/l — cos 2 and \Jl — cos 2 <f> to get their sines. (This is step 4 of Ullman's solution.) Ei- 
ther sine could be inaccurate, however, if cos or cos (f> is very close to one. Fig. 7 shows that 
when this happens one of the vectors emanating from too is nearly parallel to the image plane. 
When the rotation matrix R is computed, inaccuracy in the sines affects the elements 7*12, 7*13, 
and r23 (see Equation 49). Since 7*12 is affected, when the solution is used to transform an 
unmatched model point, the instability can propagate to points that lie in the plane containing 
the three matched model points, which is not true for the solution in this paper (Section 6). 

For Huttenlocher and Ullman's method in Section 8.5, catastrophic cancellations may occur 
in step 1 when In, l\2, /21, and I22 are computed, in step 4 when k\ and &2 are computed, and 
in step 8 when sR is computed. Instability in step 4 can affect c\ and C2 in Equation 49: If c\ is 
near zero, then h\ and &2 in Equation 66 also must be near zero. From Equations 63 and 64, h\ 
and &2 are computed with additions, and so cancellation can occur if they are small. Similarly, 
if C2 is near zero, h\ must be small as well, and so again cancellation can occur. From Fig. 8, c\ 
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or C2 is nearly zero when one of the vectors emanating from the origin (mo) is nearly parallel 
to the image plane. 

When In, ^12? ^21? an( i ^22 are computed (Equations 58-61), the results will be inaccurate if 
the determinant, x\yi — x^yi, is close to zero, which happens exactly when the model points are 
almost collinear. In addition, if any of In, I12, /21, or I22 is almost zero, then cancellation can 
occur in computing it. There are many pairs of model and image triples that can make one or 
more of In, I12, /21, 1 22 close to zero (e.g., /12 ~ whenever x\ ~ x\ and X2 ~ x~2, independent 
°f V\t V2, Vi, an d y^). Furthermore, in step 8, the additions in computing sriz and sr23 can 
also contribute to instability (see Equation 68). Note, however, that the image triangle being 
nearly collinear does not necessarily make the computation unstable. 

In Grimson et al.'s solution, instability may arise in step 5 if cos (f> is almost 1, in step 6 if t 
is 1 and uj is close to £, and in step 7 if cos (f> is near 1 or cos 9 is near 1. As with the solution in 
this paper, these situations occur when the model or image points are nearly collinear or when 
one of the sides of the model triangle that emanates from too is nearly parallel to the image 
plane. Like Ullman's method and Huttenlocher and Ullman's methods, however, instability can 
propagate to points inside the plane of the matched model points (in step 7). 

In summary, each of the three previous solutions spreads instability in the pose solution 
to points in the plane of the three matched model points; however, the solution in this paper 
does not. Furthermore, the situations in which instability can arise are the same for Ullman's 
method, the method of Grimson et al., and the solution in this paper. Specifically, these 
situations are when one of the vectors from too is parallel to the image, when the model points 
are nearly collinear, and when the image points are nearly collinear. Huttenlocher and Ullman's 
method is unstable in the first two situations as well, which is expected since in these situations 
the problem is ill conditioned (Section 6). In addition, Huttenlocher and Ullman's method can 
be unstable in many cases where the other methods are not, but may be more stable in the 
case that the image points are nearly collinear. 

10 Conclusion 

The weak-perspective three-point problem is fundamental to many approaches to model-based 
recognition. In this paper, I illustrated the underlying geometry, and then used it to derive 
a new solution to the problem and to explain the various special cases that can arise. In 
particular, the times when there are zero, one, and two solutions are described graphically. 

The new solution is based on the distances between the matched model and image points 
and is used to recover the three-space locations of the model points in image coordinates. From 
the recovered locations, a direct expression for the image location of a fourth model point is 
obtained. In contrast, earlier solutions computed an initial transformation that brought the 
model into image coordinates, and then computed an additional transformation to align the 
matched model points to their corresponding image points. As a result, the solution given here 
should be easier to use, and, for recognition systems that repeat the computation of the model 
pose many times, should be more efficient. 

Another difference with the method presented here is that it makes evident the symmetry 
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of the solution with respect to the ordering of the model and image points. Previous methods 
that are based on the coordinates of the points after some initial transformations make this 
symmetry unclear. 

Furthermore, this paper provides stability analyses for both the new and past solutions, none 
of which had been analyzed for stability previously. Each computation is examined for places 
where precision may be lost. From these places, the geometries that give rise to instability are 
inferred. These geometries are used to distinguish instabilities that arise in situations where 
the problem is ill conditioned, that is, situations where instability is inherent, from ones that 
are due to the particular computation. 

In giving another solution, this paper revisits Ullman's original biquadratic equation for the 
scale factor, but, in addition, goes on to interpret both solutions to the equation, and to prove 
which one is correct. The false solution is shown to correspond to inverting the roles of the 
model and image points. 

Lastly, the new solution is accompanied by a proof that the solution exists and is unique. 
Of the previous methods, only Huttenlocher and Ullman's demonstrates this as well, and was 
the first to do so. Such proofs may be useful for gaining insights into related problems as well 
as the problem itself. Even so, since existence and uniqueness have been established, all the 
solutions are valid, and should all be considered when a related problem needs to be solved. 
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A Rigid Transform between 3 Corresponding 3D Points 

This appendix computes a rigid transform between two sets of three corresponding points using 
right-handed coordinate systems built separately on each set of three points. A right-handed 
system is determined by an origin point, o, and three perpendicular unit vectors, (u,v,w). 
Given three points in space, #o, #1, #2, we can construct a right-handed system as follows: Let 
#01 = #i - #o and # 02 = #2 - #o- Then let 






= Po 


u 


= #01 


V 


= #02 - (#02 -#0l)#01 


w 


= U X V 



Let (oi;ui,vi,wi) and (0*2; U2, ^27^2) be the coordinate systems so defined for the original and 
camera-centered points, respectively. 

Given a coordinate system (o;u,v,w), a rigid transformation that takes a point in world 
coordinates to a point in that coordinate system is given by (R, f), where 

R = [u v w], t = o 
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(see for example [6]); the transformed p is Rp + i. Then we can bring a point p from the original 
system to the world and then to the camera-centered system using 

R2 (Rl T (p - h)) + h = R 2 Ri T P + h - R 2 Ri T fi 
where 

Rl = [ui vi wi], h = o 1 

R2 = [U2 V 2 W 2 ], t 2 = 2 . 

Consequently a rigid transformation (R, i) that aligns the two coordinate systems is 

R = R2R1 , t = t 2 — R2R1 t\ . (84) 

B Biquadratic for the Scale Factor 

This appendix shows 

4(s 2 R 2 01 - d 2 01 )(s 2 R 2 02 - d 2 2 ) = (s\R\ 2 - R 2 01 - R 2 2 ) - (d 2 2 - d 2 01 - d 2 2 )) 2 (85) 

is equivalent to a biquadratic in s. 
Expanding Equation 85, 

4 (s R 01 R 02 - s (R 01 d 02 + R 02 d 01 ) + d 01 d 02 j = 

s (R 01 + R 02 - R 12 ) - 2s (R 01 + R 02 - R 12 )(d 01 + d 02 - d 1 
+ « + 42 ~ d\ 2 f 



\) 



s [4:R 01 R 02 - (R 01 + R 02 - R 12 ) 

-2s [2R 01 d 02 + 2R 02 d 01 - (R 01 + R 02 - R 12 )(d 01 + d 02 - d 12/ 



+ (4^02 - (doi + ^02 " d\ 



\f 



as 
where 



■ 4 - 2bs 2 + c = 0, 






= 4R 01 R 02 - (R 01 + R 02 - R 12 ) 






= 2R 01 d 02 + 2R 02 d 01 — (Rqi + R 02 - 


~ #12X^01 + rf 02 " 


-d\ 2 


= 4a 01 a 02 — (a 01 + d 02 — d 12 ) . 
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C Two Solutions for Scale 

This appendix proves Proposition 1. The proof uses the following lemma: 
Lemma : Let / be either (|^-) or (j^-) . Then 

af 2 -2bf + c<0. (86) 

Proof: 

af -2bf+c 

= 4(R 01 R 02 sm^) 2 f 2 - 

2 (2(R 2 Q1 d 2 Q2 + R 2 02 d 2 Q1 - 2R iRo2doid 2 cos <f> cos ip)) f + 
4(doido2sinip) , from Equations 24, 25, and 26 



= ^^(l-cos^XT- 

(Roido2 + Rmdli ~ 2R 01 R 02 d 01 d 2 cos 4> cos ip)f + 

d 2 01 d 2 2 (l - cos 2 ?/>)) (87) 

Suppose that / = (-^rM . Then 87 becomes 

A ( ^02^01 „„ 2 , , ^R02d 01 d 02 2 t2 



2 cos <?!> + 2 cos (f) cos ip — d 01 d 02 cos ip 

Roi Roi t 

A r>2 12 ( dm , d 2 ,\ 

-4R 02 d 01 —— cos 4> - —— cos tp 

do 



Suppose instead that / = ( -^P-) • Then 87 becomes 

/ i?oi^02 2 - , -Koi^02^01 , , ,2 ,2 2 , 

4 — 2 — cos <p + 2 cos (/> cos -(/j — a 01 a 02 cos ip 

\ Ro2 R02 , 

A r>2 12 ( do2 , d i 

= -4R 01 d 02 —— cos 4> - —— cos ip 

\-n-02 -n-oi 

Either way, af 2 - 2b f + c < 0. 

D 

Proposition 1: Let 





\b- Vb 2 


— ac 


" 1 ~\ 




Then 




doi d 02 
Roi R02 


<S 2 



$2 



Ib+Vb 



2 



ac 
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Proof: Starting from the result of the lemma, 
af 2 -2bf+c<0 

- {(af - bf - (b 2 - ac)^j < 

(af — b) < b — ac, since a > 



\ a f ~ b\ < v b 2 — ac 

— (af — b) < \Jb 2 — ac and af — b < \Jb 2 

b — \/b 2 — ac , b + \/b 2 — ac 
f > and / < —-^ 



sj < f < s 2 

d i d 2 

Si < , < So 

— z? ' z? — 



ac 
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D One Solution for Scale 

In the "one solution" case, we wish to know when and if b 2 — ac = holds. Using the result of 
Appendix F, this means that 



4(R 01 d 02 ) 4 (t 2 - 2 cos(> + i/>)t + l) (t 2 - 2 cos(> - i/>)t + l) 



0. 



For this to hold, either 



t 2 - 2 cos(> + tj})t + 1 = or t 2 - 2cos((f)- ip)t + 1 = 0. 

Solving for t gives 

t = cos(cj) + ip) ± i s'm((j) + ip) or t = cos(cj) — ip) ± i s'm((j) — ip), (88) 

where i = y/—T. Consequently, there are real values of t that make b 2 — ac = only if 
s'm((j) -\- ip) = or sm((f> — ip) = 0. These situations occur when <p = ±tp and <p = ±tp + it. 
Substituting into Equation 88 gives that b 2 — ac = iff both <p = ±tp or <p = ±tp + it and t = 1, 
where £ = 1 is the same as ■#■- = -p? 2 -. 

-K01 -n-02 
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E No Solutions for Scale 

This appendix shows that there always exists a solution to the biquadratic by showing that 
b 2 — ac > 0. From Appendix F, 

b 2 - ac = 4(R 01 d 02 ) 4 U 2 -2cos(cf) + ip)t+l] (t 2 -2cos(cf)-ip)t+l] 

> 4(R 01 d 02 f (t 2 - 2i + l) (t 2 - It + l) 
= 4(R 01 d 02 ) 4 (t - l) 4 

> 

F Simplifying b 2 — ac 

In this appendix, I derive that 

b 2 -ac = 4(R 01 d 02 ) 4 (f - 2 cos(> + i/>)t + l) (t 2 - 2 cos(<£ - i/>)t + l) , (89) 

where 

_ -Rp2^01 
-^01^02 

From Equations 24, 25, and 26, 
a = 4(R 01 Ro2sm(f)) 2 

b = 2(i?oi^02 + -^02^01 ~ 2i?oi-Ro2^01^02 COS (/) cos ~ljj) 

c = 4(d 01 d 02 sin tjj) 2 



Then 



b 2 = 4(^02^01 - 4^02^01-^01^02 COS <j) COS i> + 2^01^02^01^02 + 

4i?oi-Ro2^01^02 COs2 $ COs2 V' — 4i?Q 1 (io2-Ro2^01 COS <^> COS ?/> + -^01^02^ 

ac = IGR^R^d^d^ s'm 2 cf) s'm 2 ip 



b — ac = 4 I R 02 d 01 — 4R 02 d 01 Roido2 cos <f) cos ip+ 

(2 + 4 cos 2 (f> cos 2 ij) - 4 sin 2 ^ sin 2 ^R^R^d^d? 



02 



4i?o X (io 2 i?o2^oi cos (^ cos tp + -^01^02 



4(-Roi^02) 4 (^ 4 - 4 cos ^ cos -(M 3 + (2 + 4 cos 2 (^ cos 2 ij) - 4 sin 2 ^ sin 2 ^)< 2 
4 cos <^> cos ^/>i + 1 ) , where / 



-^01^02 
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4(i?oi do2) 4 (t 4 ~ 2 (cos(<f> + 1)) + cos(^) - ^))t 3 + 

(2+ 4 cos((f) + if)) cos((f) - ij)))t 2 - 2 (cos(> + if)) + cos ((f) - ij)))t + l) 

4(R 01 d 02 ) 4 (t 2 - 2 cos(<f> + i/>)t + l) (t 2 - 2 cos(<f> - i/>)t + l) 



References 



[9 
[10: 

[11 



Ayache, N., and 0. D. Faugeras, "HYPER: A New Approach for the Recognition and 
Positioning of Two- Dimensional Objects," IEEE Trans. Pattern Anal. Machine IntelL, 
vol. 8, no. 1, pp. 44-54, January 1986. 

Ballard, D. H., "Generalizing the Hough Transform to Detect Arbitrary Shapes," Pattern 
Recognition, vol. 13, no. 2, pp. 111-122, 1981. 

Basri, R., and S. Ullman, "The Alignment of Objects with Smooth Surfaces," in Proc. 
Second Inter. Conf. Computer Vision, pp. 482-488, 1988. 

Cass, T. A., "Feature Matching for Object Localization in the Presence of Uncertainty," 
in Proc. Third Inter. Conf. Computer Vision, pp. 360-364, 1990. 

Clark, C. S., W. 0. Eckhardt, C. A. McNary, R. Nevatia, K. E. Olin, and E. M. VanOrden, 
"High-accuracy Model Matching for Scenes Containing Man-Made Structures," in Proc. 
Symp. Digital Processing of Aerial Images, SPIE, vol. 186, pp. 54-62, 1979. 

Craig, J. J., Introduction to Robotics, Reading, MA: Addison- Wesley, 1955. 

Cyganski, D., and J. Orr, "Applications of Tensor Theory to Object Recognition and Ori- 
entation Determination," IEEE Trans. Pat. Anal. Machine IntelL, vol. 7, no. 6, November 
1985. 

Cyganski, D., and J. Orr, "Object Recognition and Orientation Determination by Tensor 
Methods," Advances in Computer Vision and Image Processing, vol. 3, Thomas Huang, 
Ed., Jai Press, Inc., 1988. 

Faugeras, 0. D., and M. Hebert, "The Representation, Recognition, and Locating of 3-D 
Objects," Inter. J. Rob. Res., vol. 5, no. 3, pp. 27-52, 1986. 

Fischler, M. A., and R. C. Bolles, "Random Sample Consensus: A Paradigm for Model Fit- 
ting with Applications to Image Analysis and Automated Cartography," Communications 
of the ACM, vol. 24, pp. 381-396, June 1981. 

Crimson, W. E. L., and D. P. Huttenlocher, "On the Sensitivity of the Hough Transform 
for Object Recognition," IEEE Trans. Pat. Anal. Machine IntelL, vol. 12, no. 3, March 
1990. 

37 



[12] Grimson, W. E. L., D. P. Huttenlocher, and T. D. Alter, "Recognizing 3D Objects from 
2D Images: An Error Analysis," in Proc. IEEE Conf. Computer Vision Pat. Rec, 1992. 

[13] Haralick, R. M., C. Lee, K. Ottenberg, and M. Nolle, "Analysis and Solutions of the Three 
Point Perspective Pose Estimation Problem," in Proc. IEEE Conf. Computer Vision Pat. 
Rec., pp. 592-598, 1991. 

[14] Horn, B. K. P., "Closed-Form Solution of Absolute Orientation Using Unit Quaternions," 
J. Opt. Soc. Am., vol. 4, no. 4, April 1987. 

[15] Horaud, R., "New Methods for Matching 3-D Objects with Single Perspective Views," 
IEEE Trans. Pattern Anal. Machine IntelL, vol. 9, no. 3, pp. 401-412, May 1987. 

[16] Huttenlocher, D. P., "Three-Dimensional Recognition of Solid Objects from a Two- 
Dimensional Image," MIT TR 1045, 1988. 

[17] Huttenlocher, D. P., and S. Ullman, "Object Recognition Using Alignment," in Proc. First 
Inter. Conf. Computer Vision, pp. 102-111, June 1987. 

[18] Huttenlocher, D. P., and S. Ullman, "Recognizing Solid Objects by Alignment with an 
Image," Inter. J. Computer Vision, vol. 5, no. 2, pp. 195-212, 1990. 

[19] Jacobs, D. W., "Optimal Matching of Planar Models in 3D Scenes," in Proc. IEEE Conf. 
Computer Vision Pat. Rec, 1991. 

[20] Kanade, T., and J. R. Render, "Mapping Image Properties into Shape Constraints: Skew 
Symmetry, Afflne- Transformable Patterns, and the Shape-from- Texture Paradigm," Hu- 
man and Machine Vision, Beck, Hope, and Rosenfeld, Eds., Academic Press, 1983. 

[21] Lamdan, Y., J. T. Schwartz, and H. J. Wolfson, "Object Recognition by Affine Invariant 
Matching" in Proc. IEEE Conf. Computer Vision Pat. Rec, pp. 335-344, 1988. 

[22] Lamdan, Y., and H. J. Wolfson, "Geometric Hashing: A General and Efficient Model-Based 
Recognition Scheme," in Proc. IEEE Conf. Computer Vision Pat. Rec, pp. 238-249, 1988. 

[23] Linnainmaa, S., D. Harwood, and L. S. Davis, "Pose Determination of a Three-Dimensional 
Object Using Triangle Pairs," IEEE Trans. Pattern Anal. Machine IntelL, vol. 10, no. 5, 
pp. 634-647, Sept. 1988. 

[24] Roberts, L. G., "Machine Perception of Three-Dimensional Solids," Optical and Electro- 
Optical Information Processing, J. T. Tippett et al., Eds., MIT Press, Cambridge, MA, 
1965. 

[25] Thompson, D. W., and J. L. Mundy, "Three-Dimensional Model Matching from an Un- 
constrained Viewpoint," in Proc. IEEE Conf. Rob. Aut., pp. 208-220, 1987. 

[26] Turney, J. L., T. N. Mudge, and R. A. Voltz, "Recognizing Partially Occluded Parts," 
IEEE Trans. Pat. Anal. Machine IntelL, vol. 7, no. 4, July 1985. 

38 



[27] Ullman, S., "Computational Studies in the Interpretation of Structure and Motion: Sum- 
mary and Extension," Human and Machine Vision, Beck and Rosenfeld, Eds., Academic 
Press, 1983. 

[28] Ullman, S., "An Approach to Object Recognition: Aligning Pictorial Descriptions," MIT 
A.I. Memo 931, December 1985. 

[29] Ullman, S., "Aligning Pictorial Descriptions: An Approach to Object Recognition," Cog- 
nition, vol. 32, no. 3, pp. 193-254, August 1989. 

[30] Ullman, S., and R. Basri, "Recognition by Linear Combinations of Models," IEEE Trans. 
Pat. Anal. Machine IntelL, vol. 13, no. 10, pp. 992-1006, October 1991. 

[31] Watkins, D., Fundamentals of Matrix Computations, New York: John Wiley & Sons, Inc., 
1991. 



39 



